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Integrated circuit and method for establishing transactions 



The invention relates to an integrated circuit comprising a network and a 
plurality of modules, which are arranged to communicate to each other via the network, 
wherein the network is arranged to establish transactions between a first module and at least 
two second modules, the network being arranged to send a plurality of requests from the first 
5 module to the second modules, and wherein the second modules are arranged to generate 
individual responses indicating a result of me execution of the requests. 

The invention also relates to a method for establishing transactions in an 
integrated circuit comprising a network and a plurality of modules, the transactions between 
the modules being established via the network, wherein the network sends a plurality of 
10 requests from a first module to at least two second modules, and wherein the second modules 
generate individual responses indicating a result of the execution of the requests. 

Systems on silicon show a continuous increase in complexity due to the ever- 
15 increasing need for implementing new features and improvements of existing functions. This 
is enabled by the increasing density with which components can be integrated on an 
integrated circuit At the same time the clock speed at winch circuits are operated tends to 
increase too. The higher clock speed in combination with the increased density of 
components has reduced the area which can operate synchronously within the same clock 
20 domain. This has created the need for a modular approach. According to such an approach 
the processing system comprises a plurality of relatively independent, complex modules. In 
conventional processing systems the modules usually communicate to each other via a bus. 
As the number of modules increases however, this way of communication is no longer 
practical for the following reasons. First, the large number of modules forms a too high bus 
25 load. Second, the bus forms a communication bottleneck as it enables only one device to send 
data to the bus. 

A communication network forms an effective way to overcome these 
disadvantages. The communication network comprises a plurality of partly connected nodes. 
Requests from a module are redirected by the nodes to one or more other nodes. To that end 
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the request comprises first information indicative for the location of the addressed module(s) 
within the network. The request may further include second information indicative for a 
particular location within the module, such as a memory, or a register address. The second 
information may invoke a particular response of the addressed module. 
5 A transaction model can he used in a network on an integrated circuit to 

establish communication between the modules. A basic transaction comprises a request and a 
response which indicates the result of the execution of the request In a multicast transaction, 
the request from a first module is replicated and each addressed module receives a copy of 
the request, so that the first module sends a plurality of requests to at least two second 

10 modules. Subsequently, the second modules send individual responses to the first module. 

The concept of multicasting has been applied in areas different from networks 
on integrated circuits, but its implementation is rather limited until now in the sense that it 
only covers the acknowledgment of the receipt of a plurality of write messages instead of the 
acknowledgment of the execution of a plurality of requests. A request may comprise a write 

1 5 command and a data part or it may comprise a read command. According to the state of the 
art, it is possible to send a plurality of write messages from a first module to two or more 
second modules. This is a multicast write message; the second modules can send 
acknowledge messages to the first module which indicate whether the write messages have 
been received. However, this method of multicasting is limited because the acknowledgments 

20 do not indicate whether the write messages have been executed by the second modules: * 
Such a method of multicasting is disclosed in US 5,541,927. The method 
limits the number of return messages from a plurality of destination nodes to a source node, 
which is accomplished using intermediate nodes in the network. The intermediate nodes are 
the only nodes in the entire network that are authorized to send return messages to the source 

25 node. Underlying nodes send their return messages to the intermediate nodes, but not to the 
source node. This method reduces the number of return messages to the source node and it 
elaborates on merging acknowledge messages which merely indicate the receipt of a 
message. 

A shortcoming of the multicast transaction is that the individual responses 
30 from the second modules (also referred to as slaves, slave modules or destinations) impose a 
large burden on the first module (also referred to as master, master module or initiator). 
Consequently, the complexity of the first module increases because all individual responses 
from the second modules must be processed by the first module. Furthermore, the first 
module is less reusable as a network component because it depends on the number of second 
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modules. This makes the network architecture incompatible with the bus architecture, since 
the first module does not depend on the number of second modules when the bus architecture 
is used. 

5 

It is an object of the invention to provide an integrated circuit and a method of 
the kind set forth which reduce the burden on the first module. In order to achieve the said 
object the integrated circuit is characterized by the characterizing portion of claim 1 and the 
method is characterized by the characterizing portion of claim 9. 

10 In a processing system with modules working asynchronously with respect to 

each other a second module typically sends an individual response to inform the first module 
that it has executed the request of the first module. If a request is multicast a plurality of said 
individual responses is generated, which imposes a large burden on the first module. In the 
integrated circuit of the invention the first module receives only a single response, which 

1 5 reduces this burden. 

A dedicated node in the network may be used for generating and sending the 
single response. The embodiment defined in claim 2 comprises a network interface to 
generate and send the single response. 

The embodiment defined in claim 3 is favorable if the value of the single 

20 response depends on the values of the individual responses from-the second modules. This- < 
results in a combined response, representing the output of a specific function of the 
individual responses from the second modules. The specific function returns the value of the 
single response, which is based on the values of the individual responses. 

Depending on circumstances, the single response can be based on the 

25 individual responses in various ways. The embodiment defined in claim 4 is favorable where 
the addressed second modules are duplicated memories, for example memories in a fault- 
tolerant memory system, and the first module attempts to store data therein. In that case it is 
sufficient that only one copy of the data is received and stored. The specific function 
indicates a success by returning a value representing a success, hi this embodiment, the 

30 specific function returns a success if at least one value of the individual responses represents 
a success. 

In other situations it is compulsory that each of the addressed second modules 
executes the request, for example if the addressed second modules are memories in a 
distributed memory system. In the embodiment defined in claim 5 the single response is not 
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generated until this is the case. The single response is generated only if all individual 
responses have a value representing success. 

The embodiment defined in claim 6 represents a particular case, wherein the 
specific function returns a value representing success if no error occurred and if at least one 
5 error occurred a value representing the most serious error. 

The embodiment defined in claim 7 represents another particular case, wherein 
the values of the individual responses of the second modules are specified according to the 
type of error that occurred. This embodiment is favorable when it is necessary to determine 
the cause of the error that occurred; mis cause is then communicated to the first module. If 
10 several errors occur, alternative values for the single response can be generated. It is possible 
to choose the value of the most serious error that occurred for the value of the single 
response, or the single response may be a combined response containing all the values of the 
individual responses, providing complete information about the errors that occurred. 

The embodiment defined in claim 8 can be used to perform a compound 
1 5 command like the test-and-set command by means of subsequent multicast transactions. In 
that case, the single response of the first multicast transaction carries data parts of the second 
modules and indicates which data parts belong to which second modules. This information is 
needed by the first module to perform a conditional test and to send another plurality of 
requests, so that new data are written to those second modules that passed the conditional 

' 20 test. 1 '* — - * •* r 

The invention overcomes the shortcomings of multicast transactions in 
networks on an integrated circuit, because the amount of responses to the first module is 
reduced from many to one. 

It is noted that a method of multicasting is disclosed in WO 02/23814. Hie 
25 method merges acknowledge messages in networked environments other than networks on 
integrated circuits using switches as connecting nodes. The method assumes that return 
messages arrive simultaneously, thus limiting the use of merged acknowledgements to a 
particular situation. 

30 

The present invention is described in more detail with reference to the 
drawings, in which: 

Fig. 1 illustrates a network on an integrated circuit; 
Fig. 2 illustrates a concept of multicast messages; 
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Fig. 3 illustrates a concept of multicast transactions according to the invention; 
Pig. 4 illustrates a multicast transaction in a network on an integrated circuit; 
Fig. 5 illustrates a multicast transaction according to fee invention; 
Fig. 6 illustrates a network on an integrated circuit which deploys a network 

5 interface; 

Fig. 7 illustrates a multicast transaction with a single response, wherein at least 
one second module must receive the requests issued by the first module; 

Fig. 8 illustrates a multicast transaction with a single response, wherein all 
second modules must receive fee requests issued by fee first module; 
10 Fig. 9 illustrates a multicast transaction wife a single response, wherein fee 

value of the response indicates fee most serious error feat occurred. 

Fig. 1 0 illustrates a possible implementation of fee network functionality 
according to fee invention; 

Fig. 1 1 illustrates an alternative implementation of fee network functionality . 
1 5 according to fee invention. 

Fig. 1 schematically shows an integrated circuit IC which deploys a network 
for communication between a plurality of modules Mi, M 2 , M 3 up to and including M n . 

20 Examples of modules are central processing units (CPUs), application specific processors, 
memories and memory controllers. The network comprises nodes Ni, N 2 up to and including 
N m and connections between fee nodes. This network architecture provides fee interconnect 
between the modules and can be deployed as an alternative for the conventional bus 
architecture on an integrated circuit 

25 Fig. 2 illustrates a concept of multicast messages. A first module Mi sends a 

replicated write message MSG to at least two second modules M2, M3 or alternatively fee 
write message MSG is replicated by fee network. The acknowledgements of fee second 
modules M 2 , M 3 merely indicate fee receipt of fee messages MSG; they are combined into a 
single acknowledgement ACK which is sent to fee first module Mi after a certain amount of 

30 time T. In this manner the result of the execution EXEC of fee messages MSG is not taken 
into account This concept of multicast messages is known from fee state of fee art and is 
applicable in networks on an integrated circuit 

Fig. 3 illustrates a concept of multicast transactions according to fee invention. 
A first module Mi sends a replicated request REQ to at least two second modules M 2 , M 3 . 
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The individual responses RESP2, RESP3 of the second modules M 2 , M 3 indicate the result of 
the execution EXEC of the requests; they are combined into a single response SRESP which 
is sent to the first module Mi after a certain amount of time T. 

Fig. 4 illustrates a multicast transaction which imposes a large burden on the 
5 first module Mi. The transaction comprises a replicated request leading to a plurality of 
requests REQ and a plurality of individual responses RESP2, RESP3 up to and including 
RESPn. The integrated circuit IC as illustrated in FIG. 1 comprises a plurality of modules Mi, 
M 2 , M 3 up to and including Mn, connected by a network. A first module Mi, also referred to 
as master, master module or as initiator, is configured to send the requests REQ to second 

10 modules M 2 , M 3 up to and including M n , also referred to as slaves, slave modules or as 

destinations. The second modules are configured to send the individual responses RESP2, 
RESP3 up to and including RESPn to the first module. 

A multicast transaction according to the invention is illustrated in FIG. 5. The 
transaction comprises a replicated request leading to a plurality of requests REQ and a single 

IS response SRESP. The integrated circuit IC again comprises a plurality of modules Mi, M 2 , 
M 3 up to and including Mn, connected by a network. Through this network a single response 
SRESP, based on the individual responses from the second modules M 2 , M 3 up to and 
including M m can be sent to the first module Mi. The network is configured to send a single 
response SRESP to the first module Mi which indicates the result of the execution of the 

20 requests REQ. ' " • - ' 

For this purpose the network can deploy a network interface which is coupled 
to the first module Mi. The network interface NI is then a component of the network which is 
coupled to the first module Mi and to at least one of the nodes Ni, N 2 up to and including N m 
as illustrated in FIG. 6. The network interface NI is able to combine the individual responses 

25 RESP2, RESP3 up to and including RESPn from the second modules M 3 up to and 
including M n and generate a single response SRESP to the first module Mi. Since the 
network interface NI is arranged to perform this task instead of the first module Mi, the 
burden on the first module is reduced significantly. Alternatively, a dedicated node in the 
network can perform this task depending on the configuration of the network. Since in this 

30 manner the first module Mi is made independent from the number of second modules M 2 , M 3 
up to and including M n , the reusability of the first module as a network component improves 
significantly. 
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A request comprises a basic command, for example a read or a write 
command, and optionally it comprises a data part A response comprises an 
acknowledgement and optionally it comprises a data part 

For example, the requests REQ in a multicast transaction carry a read 
5 command. The corresponding single response SRESP then carries an acknowledgement, 
indicating the result of the execution of the read command by at least one of or by all second 
modules M2, M 3 up to and including M m and it also carries the data, which are delivered to 
the first module M 1 . Alternatively, the requests REQ carry a write command and the data, 
which have to be written to the second modules M2, M 3 up to and including M n . The 
10 corresponding single response SRESP then carries an acknowledgement, but it does not carry 
a data part 

An example of a more complex command is the test-and-set command, also 
referred to as a compound command. The test-and-set command writes data to at least one of 
the second modules M 2 , M 3 up to and including M n dependent on a conditional test performed 
15 on the second modules. The following multicast transactions are needed to perform this 
compound command: 

a plurality of requests REQ to read the data needed to perform the conditional 
test, the requests carrying a read command and information which indicates that a flag should 
be set on the slaves, the flag indicating that other masters than master Mi should not perform 
20 write operations on the slaves; the corresponding single response SRESP carrying data parts , 
of the second modules and indicating which data parts belong to which second modules; 

a plurality of requests REQ to write new data to those second modules which 
passed the conditional test, the requests carrying a write command, a data part and 
information which indicates that the said flag should be unset; the corresponding single 
25 response SRESP carrying an acknowledgement of the write operations. 

The single response SRESP carrying data parts of the second modules M2, M 3 up to and 
including M n and indicating which data parts belong to which second modules forms part of a 
read transaction which can be used independently or which can be used as a constituent to 
perform the said test-and-set command. 
30 Other particular commands (not described) may also use the concept of 

multicast transactions which is disclosed herein. 

As an example of the return values for a request comprising a read or a write 
command, the individual responses from the slaves RESP2, RESP3 up to and including 
RESPn can have the following values and their respective meanings: 
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6 OK' : the command has been completed successfully; 
'ERRJDATA* : corrupted data received at or written to slave module; 
'ERR_DROPPED ' : data dropped by the interconnect due to internal buffer 

overflow; 

5 - 'ERR_PWR': command could not be performed because the slave is in power- 

saving mode; 

'ERRSLAVE': command failed due to internal error of the slave; 

'ERR_ADDR' : command failed because of an invalid address. 

The single response SRESP may also have one of the above-mentioned values, 

10 dependent on the values of the individual responses RESP2, RESP3 up to and including 
RESPn from the slaves. For example, if the requests REQ were executed successfully by a 
subset of the slaves and if the requests REQ resulted in an invalid address error by a different 
subset of the slaves, then the individual responses RESP2, RESP3 up to and including RESPn 
of the slaves can have two different values: 'OK* and 'ERR_ADDR\ Alternatively, the 

1 5 individual responses RESP2, RESP3 up to and including RESPn can have other values 

depending on the type of error that occurred One of the values can be marked as the value 
representing the most serious error, for example 'ERR_ADDR\ The value 'OK* is marked as 
the value representing no error. Depending on circumstances, the single response has the 
value 'OK' or a value representing the most serious error of the individual responses. 

20 -•-•*-• * • - Using a compound command like die test-and-set command may require other 
contents of the single response SRESP. In the example of the test-and-set command, the 
single response SRESP of the first multicast transaction can carry data parts of the second 
modules M 2 , M 3 up to and including M n and can indicate which data parts belong to which 
second modules. 

25 In an embodiment of the invention shown in FIG. 7, at least one of the 

individual responses from the slaves must have the value 'OK' before the single response 
with value 'OK' for the master is generated. 

In an embodiment of the invention illustrated in FIG. 8, all individual 
responses from the slaves must have the value 'OK' before the single response with value 

30 'OK' for the master is generated. 

In another embodiment of the invention shown in FIG. 9, the values of the 
individual responses from the slaves can be combined into a single response with the value 
'ERR_ADDR' to specify that at least one error occurred and that the most serious error was 
an invalid address error. The single response has the value 'ERR_ADDR' instead of 
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'ERRPWR' because an error caused by an invalid address is considered more serious than 
an error caused by the power-saving mode of a slave. Alternatively, another error may be 
considered more serious than the invalid address error, and therefore the hierarchy of error 
messages may be different 
5 In another embodiment (not shown), a single response is generated, which is 

larger and more descriptive, encoding for which slaves the errors have occurred. In this 
embodiment all individual responses can be bundled in the single response for the master or 
<slave identifier, error code> pairs can be bundled to form the single response. 

Fig. 1 0 illustrates a possible implementation of the network functionality 

10 according to the invention. A single response generator SRESP_GEN generates a single 

response SRESP based on a function F of a plurality of individual responses RESP from the 
second modules. In this case queues Qi, Q 2 , Q 3 , Q4 are associated with four second modules 
sending individual responses RESP. The single response generator SRESPGEN is 
comprised in a network interface NL Alternatively, the single response generator 

1 5 SRESP GEN is comprised in a dedicated node within the network. The network may 
comprise more than one single response generator SRESP__GEN. 

The single response generator SRESPGEN has queues Qi, Q 2 , Q 3 , Q 4 in 
which the individual responses RESP are queued in order. This facilitates ordered data 
transport and in this manner it is possible to perform reordering of responses before queuing. 

20 If several single responses SRESP should be delivered to the first module Mi, then thtfsingle 
responses SRESP must be delivered in order. If individual responses RESP for a subsequent 
single response SRESP exist in the queues, then the scheduler SCHED is notified. The 
scheduler SCHED passes on one individual response RESP at a time to a function F. The 
function F can be a comparison function, for example a function to generate a single response 

25 SRESP with a value representing the most serious error that occurred. If all individual 
responses RESP have been considered or if the result of function F cannot be changed by 
remaining individual responses RESP,"then the result of function F is passed on as the single 
response SRESP. 

An alternative implementation is shown in FIG. 1 1, in which generating 
30 several single responses SRESP can be pipelined. A subsequent single response SRESP2 can 
start being processed if some its individual responses RESP2 have arrived (for example in 
queues Q 2 and Q 3 ), even if the single response SRESP1 has not been processed completely 
because not all of its individual responses RESP1 have arrived (only those in queues Qi and 
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Q 4 have arrived). This example illustrates the principle of pipelining for a pipeline depth of 2; 
it can be generalized to a variable pipeline depth of N. 

It is remarked that the scope of protection of the invention is not restricted to 
the embodiments described herein. Neither is the scope of protection of the invention 
5 restricted by the reference symbols in the claims. The word 'comprising' does not exclude 
other parts than those mentioned in a claim. The word 'a(n)* preceding an element does not 
exclude a plurality of those elements. Means forming part of the invention may both be 
implemented in the form of dedicated hardware or in the form of a programmed general- 
purpose processor. The invention resides in each new feature or combination of features. 
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CLAIMS: 



1 . Integrated circuit (IC) comprising a network and a plurality of modules (Mi, 
M 2 , M 3 up to and including MJ, which are arranged to communicate to each other via the 
network, wherein the network is arranged to establish transactions between a first module 
(Mi) and at least two second modules (M 2? M 3 up to and including Mq), the network being 

5 arranged to send a plurality of requests (REQ) from the first module to the second modules, 
and wherein the second modules are arranged to generate individual responses (RESP2, • 
KESP3 up to and including RESPn) indicating a result of the execution of the requests 
(REQ), characterized in that the network is arranged to generate a single response (SRESP) 
to the first module (Mi), dependent on the individual responses (RESP2, RESP3 up to and 
10 including RESPn) of the second modules (M 2 , M 3 up to and including Mq). 

2. Integrated circuit (IC) according to claim 1, wherein the network comprises a 
network interface (NI) to generate the single response (SRESP) to the first module (Mi). 

15 3. Integrated circuit (IC) according to claim 1 , wherein the single response 

(SRESP) has a value which is dependent on a specific function of the individual responses 
(RESP2, RESP3 up to and including RESPn) of the second modules. 

4. Integrated circuit (IC) according to claim 3, wherein the specific function is 
20 defined such that the value of the single response (SRESP) indicates that at least one of the 

second modules (M 2 , M 3 up to and including MJ has successfully executed the requests 
(REQ) issued by the first module (Mi).. 

5. Integrated circuit (IC) according to claim 3, wherein the specific function is 
25 defined such that the value of the single response (SRESP) indicates that each of the second 

modules (M 2 , M 3 up to and including M n ) has successfully executed the requests (REQ) 
issued by the first module (Mi). 
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6. Integrated circuit (IC) according to claim 3, wherein the specific function is 
defined such that the value of the single response (SRESP) indicates a success if no error 
occurred and the value of the single response indicates a failure if at least one error occurred, 
wherein the value of the single response represents the most serious error. 

5 

7. Integrated circuit (IC) according to claim 3, wherein the specific function is 
defined such that the value of the single response (SRESP) indicates which types of error 
have occurred during execution of the requests (REQ). 

10 8. Integrated circuit (IC) according to claim 1 , wherein the individual responses 

(RESP2, RESP3 up to and including RESPn) carry data parts transmitted by the second 
modules (M 2t M 3 up to and including M n ), the single response (SRESP) comprising the data 
parts and indicating which data parts originate from which second modules. 

15 9. Method for establishing transactions in an integrated circuit (IC) comprising a 

network and a plurality of modules (Mi, M 2 , M 3 up to and including Mn), the transactions 
between the modules being established via the network, wherein the network sends a 
plurality of requests (REQ) from a first module (Mi) to at least two second modules (M 2 , M 3 
up to and including M n ), and wherein the second modules generate individual responses 

20 (RESP2, RESP3 up to and including RESPn) indicating a result of the execution of the 

requests (REQ), characterized in that the network generates a single response (SRESP) to the 
first module (Mi), dependent on the individual responses (RESP2, RESP3 up to and 
including RESPn) of the second modules (M 2 , M 3 up to and including Mn). 
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ABSTRACT: 



An integrated circuit (IC) comprises a network and a plurality of modules (Mi, 
M2M3 up to and including M n ) which communicate to each other via the network. A first 
module (Mi) sends a plurality of requests (REQ) to at least two second modules (M 2 up 
to and including Mn) and the second modules send individual responses (RESP2, RESP3 up 
5 to and including RESPn) to trie first module, indicating a result of the execution of the 

requests. The integrated circuit (IC) according to the invention comprises a network capable 
of sending a single response (SKBSP) to the first module (Mi) dependent on the individual 
responses (RESP2, RESP3 up to and including RESPn) from the second modules (M 2 JM3 up 
to and including Mn). The single response (SRESP) can indicate that at least one second 

10 module has executed the requests (REQ), that each second module has executed the requests 
(REQ) or that a specific error has occurred in at least one of the second modules (M 2 Ms up 
to and including Mn). The single response (SRESP) can also indicate which types of error 
have occurred in the second modules (M 2 ,M 3 up to and including Mn). If various errors have 
occurred, then the single response (SRESP) can indicate which error is the most serious error 

15 or it can provide information about all errors. 
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